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Networks of fast-spiking interneurons are crucial for the generation of neural oscillations in the brain. Here 
we study the synchronous behavior of interneuronal networks that are coupled by delayed inhibitory and fast 
electrical synapses. We find that both coupling modes play a crucial role by the synchronization of the network. 
In addition, delayed inhibitory synapses affect the emerging oscillatory patterns. By increasing the inhibitory 
synaptic delay, we observe a transition from regular to mixed oscillatory patterns at a critical value. We also 
examine how the unreliability of inhibitory synapses influences the emergence of synchronization and the os- 
cillatory patterns. We find that low levels of reliability tend to destroy synchronization, and moreover, that 
interneuronal networks with long inhibitory synaptic delays require a minimal level of reliability for the mixed 
oscillatory pattern to be maintained. 

PACS numbers: 87.19.1g, 05.45.Xt, 89.75.Kd 



I. INTRODUCTION 

Synchronization is an important phenomenon that occurs in 
many biological and physical systems [1]. In the brain, the 
rhythmic oscillations of concerted electrical activity, which 
are representative for the synchronous firing of neurons, have 
been observed in different regions, including the neocortex, 
hippocampus and thalamus [2, 3]. Since neural oscillations 
are associated with many high-level brain functions, the per- 
tinent research has attracted considerable attention in the past 
decades [2-A]. It has been proposed that these oscillations not 
only carry information by themselves, but that they may also 
regulate the flow of information and assist by its storage and 
retrieval in neural circuits [5]. 

In the brain, fast-spiking interneurons are mutually con- 
nected by both inhibitory chemical synapses as well as elec- 
trical synapses (gap junctions) [6]. The evidence is mount- 
ing that networks composed of fast-spiking interneurons could 
provide synchronization mechanisms by means of which im- 
portant rhythmic activities, such as the gamma (7: 25-100 
Hz) rhythm and the mixed theta (8: 4-12Hz) and gamma 
rhythm [7-9], can be generated. Computational studies indi- 
cate that inhibitory and electrical synapses play an important 
role by the generation of these oscillations. For example, it has 
been shown that interneuronal networks with solely inhibitory 
synapses can produce gamma oscillations, but that adding gap 
junctions to the network can further increases their stability 
and coherence [8]. It has also been reported that interneuronal 
networks coupled by both fast and slow inhibitory synapses 
can produce the mixed theta and gamma rhythmic activity [9]. 
In addition, several theoretical studies have been performed 
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to provide a deeper understanding of how the inhibitory and 
electrical synapses promote synchronization amongst coupled 
neurons [10]. 

Information transmission delays, which are due to the finite 
propagation speeds and due to time lapses occurring by both 
dendritic and synaptic processing [11], are also an inherent 
part of neuronal dynamics. In particular the transmission de- 
lays of chemical synapses are not to be neglected [11]. Physi- 
ological experiments have revealed that they can be up to sev- 
eral tenths of milliseconds in length [12]. On the other hand, 
the transmission delays introduced by electrical synapses are 
comparably short, usually not exceeding 0.05 milliseconds 
[12], so they are often not taken explicitly into account. In 
terms of dynamical complexity, the existence of time delays 
makes a nonlinear system with a finite number of degrees of 
freedom become an infinite-dimensional one, which may en- 
rich the dynamics [13], enhance synchronization [14], and fa- 
cilitate spatiotemporal pattern formation [15]. 

Although existing studies attest clearly to the fact that in- 
formation transmission delays have a significant impact on 
the synchronization of interneuronal networks, to the best of 
our knowledge the focus has always been on considering only 
short inhibitory synaptic delays [16]. However, since as noted 
above, the delays of chemical synapses may be substantial, it 
is also of interest to consider long inhibitory synaptic delays. 
Given that previous studies have shown that different time de- 
lay lengths may have rather different effects on the synchro- 
nization of coupled nonlinear oscillators [14, 15], we antici- 
pate that the consideration of long inhibitory synaptic delays 
may lead to new and inspiring results. 

To resolve this, we here study the synchronization in an in- 
terneuronal network that is coupled by both delayed inhibitory 
as well as fast electrical synapses, focusing specifically on the 
effects of inhibitory synaptic delays covering a wide window 
of values. Our simulations reveal that the delayed inhibition 
not only plays an important role in network synchronization, 
but that it can also lead to different oscillatory patterns. The 
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comparatively fast gap-junctional coupling, on the other hand, 
contributes solely to the synchronization of the network but 
does not affect the emergence of oscillatory patterns. Most in- 
terestingly, we show that a sufficiently long inhibitory synap- 
tic delay induces a rapid transition from the one-frequency to 
the two-frequency state, thus leading to the occurrence of a 
mixed oscillatory pattern. Moreover, we also show that the 
unreliability of inhibitory synapses has a significant impact 
on both the synchronization and the emergence of oscillatory 
patterns. Our findings thus add to the established relevance 
of time delays in neuronal networks and highlight the impor- 
tance of synaptic mechanisms for the generation of synchro- 
nized neural oscillations. 

The reminder of this paper is organized as follows. In Sec- 
tion II, we present the mathematical model and introduce the 
synchronization measure. Main results are presented in Sec- 
tion III, while in Section IV we summarize our work and 
briefly discuss potential biological implications of our find- 
ings. 

II. MATHEMATICAL MODEL 

We consider a network composed of N fast-spiking in- 
terneurons. Neurons in the network are randomly connected 
by inhibitory and electrical synapses with probability p c and 
p e , respectively. For simplicity, all synapses are bidirectional. 
We do not allow a neuron to be coupled to another neuron 
more than once by using the same type of synaptic coupling, 
or a neuron to be coupled with itself. We assume that all 
electrical synapses are fast, thus considering delays only by 
the inhibitory synapses. This assumption is reasonable, as we 
have argued in the Introduction. The dynamics of fast-spiking 
interneurons is described by the Wang-Buzsaki model [17]. 
It has a form similar to the classical Hodgkin-Huxley model 
[11, 18], with details as follows [17]: 

C-^jT = ~ 9Namihi(Vi - E N . d ) - 9Knt(Vi - E K ) 

where the three gating variables obey the following equations 

mi = a mi (Vi)/ [a mi (Vi) + j3 mi (Vi)] , 

^ = <j>[a hi (Vi)(l - h) - p hi {Vi)hi] , (2) 
dft ■ 

= <j>[a ni {Vi)(i - m) - p ni {Vi)m) . 

Here i = 1,2,...,N is the neuron index, Vi denotes 
the membrane potential of neuron i, and the six rate 
functions are [17]: a mi (Vi) = 0.1(V, + 35)/(l - 
cxp (-0.1(^ + 35))), PmM) = 4exp(-(K + 60)/18), 
a hi (V) = 0.07exp(-(Vi + 58)/20), p hi (Vi) = 
l/(exp (-0.1(^ + 28)) + 1), a ni (Vi) = 0M(V + 
34)/(l - exp (-0.1(^ + 34))), and (3 ni (V t ) 
0.125 exp (-(Vi +44)/80). If" is the synaptic current 
of neuron i due to the interactions with other neurons within 
the network (also referred to as internal synaptic current 




FIG. 1. (Color online) Firing rate curve of the Wang-Buzsaki model 
in dependence on the externally applied current J app in the absence 
of additional inputs. 



in this paper), and 1^ is an externally applied current 
representing the collective effect of inputs coming from the 
outside of the network. In this work, we model the externally 
applied current as I* pp = In + a/j,i(t), where Io is the 
mean current, ^ (t) is an independent Gaussian white noise 
with zero mean and unit variance, and a is the intensity of 
stochastic fluctuations. The parameters of the Wang-Buzsaki 
model assume standard values [17]: C = 1 /iF/cm 2 , = 35 
ms/cm 2 , E N . d = 55 mV, g K = 9 ms/cm 2 , E K = —90 mV, 
g L = 0.1 ms/cm 2 , E L = —65 mV, and (j> = 5. A spike 
is detected whenever the membrane potential exceeds the 
threshold of V t h = —10 mV. Figure 1 shows the firing rate 
curve of the Wang-Buzsaki model when the later is driven 
solely by the externally applied current (cr = 0). 

For each neuron, the internal synaptic current consists of 
two terms, which are 

^ (t) = J2j Wi * r *i - + E fc Sik [Vu -Vi]. (3) 

In this equation, the first and second outer sums run over all 
inhibitory and electrical synapses onto neuron i, Wij is the in- 
hibitory synaptic strength from neuron j to neuron i, rij is the 
corresponding inhibitory synaptic variable, Ej n h = —80 mV 
is the reversal potential for inhibitory synapses, and g^ is the 
electrical synaptic strength from neuron k to neuron i. For 
inhibitory synapses, once a presynaptic neuron emits a spike, 
the corresponding is updated after a fixed spike transmis- 
sion delay r,j, according to ry ^— + 1. Otherwise 
decays exponentially with a fixed time constant t s . For sim- 
plicity, we set Wij = w, Tij = r and = g throughout this 
paper, implying that the coupling is identical for the same type 
of synapses. 

To characterize the synchronization within the network, a 
dimensionless synchronization measure S is introduced, fol- 
lowing [19]. We first compute the time fluctuations of the 
average membrane potential according to 

A N = (A N (tf) t -(A N (t))l (4) 

where the sign {•)( denotes the average over time and 
A/v(i) = J2i=i Vi(t)/N is the average membrane potential 
at time t. Subsequently, the population-averaged variance of 
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the activity of each individual neuron is determined according 
to 

1 N 

i=i 

Finally, the synchronization measure is computed as 

S=^. (6) 

From this it follows that the larger the value of S the better the 
synchronization in the network. 

The described mathematical model is integrated numeri- 
cally using the fourth-order Runge-Kutta algorithm with a 
fixed time step of h = 0.025 ms. This is sufficiently small 
to ensure an accurate simulation of the Wang-Buzsaki model 
[17]. For each set of parameters, the initial membrane po- 
tentials of neurons are uniformly distributed between -70 and 
30 mV. The network size is TV = 300, while p c = 0.1 and 
p e = 0.05. We always generate both types of synapses, 
but use g = to denote the network without the fast gap- 
junctional coupling. The two parameters that determine the 
externally applied current are Iq = 1.4 /iA/cm 2 and a = 0.25 
fiA ms 1 / 2 /cm 2 . Under these conditions, the mean firing rate 
of the Wang-Buzsaki model is approximately 80 Hz in the 
absence of the internal synaptic current. We perform all simu- 
lations up to 3000 ms, and collect the data from 1000 to 3000 
ms for further statistical analysis. The reported results, except 
for the spike raster diagrams, are averages over 30 indepen- 
dent runs. 
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FIG. 2. (Color online) Spike raster diagrams for different values of 
the inhibitory synaptic delay r. (a) Without fast electrical synapses 
(<? = 0). (b) With fast electrical synapses (g — 0.01 ms/cm 2 ). In 
all cases we set w = 0.01 ms/cm 2 and r s = 10 ms. From top to 
bottom, t = 0,7, 13, 18 and 30 ms, respectively. The red rectangle in 
the middle panel of (a) illustrates that, without the fast gap-junctional 
coupling, the synchronous firing of the last group in each periodic 
cycle is weak when r is near the transition point. The black double 
arrow line in the bottom panel of (b) denotes one periodic cycle for 
the mixed oscillatory pattern. 



III. RESULTS 

We first show elementary simulation results that reveal how 
the delayed inhibitory and fast gap-junctional coupling influ- 
ence the synchronous behavior of the considered interneu- 
ronal network. In Figs. 2(a) and 2(b), several typical spike 
raster diagrams for different values of the inhibitory synaptic 
delay r, without (g = 0) and with (g ^ 0) the fast elec- 
trical synapses, are plotted, respectively. Presented results 
show clearly that delayed inhibitory as well as fast electrical 
synapses play an important role by the synchronization of the 
network. Without the fast gap-junctional coupling, the neu- 
ronal firings at r = are rather disordered. Essentially this 
is because the considered network (p c = 0.1) is sparse, i.e., 
there are not much more links between the neurons (on av- 
erage) than there are neurons constituting the network, and 
hence cannot be easily synchronized in the absence of addi- 
tional mechanisms that promote the onset of synchronization. 
By introducing inhibitory synaptic delays, an improvement in 
the synchronization of the network can be observed. However, 
it can also be observed that this depends significantly on the 
length of the inhibitory synaptic delay. Only suitable delays 
can help the network to maintain a high level of synchroniza- 
tion (compare results obtained with r = 7, 18 and 30 ms, and 
t = 13 ms in Fig. 2(a)). We demonstrate this quantitatively in 
Fig. 3(a), where also a near periodic oscillatory behavior in S 



can be detected, which may be related to the matching of the 
inherent neuronal time scales with the duration of the delay, as 
proposed in [14] (we will discuss this near-periodic oscillatory 
behavior further shortly). Furthermore, the results presented 
in Fig. 2(b) suggest that the fast electrical synapses provide a 
strong mechanism for fostering synchronization. With the fast 
gap-junctional coupling turned on, the high-quality synchro- 
nization may be observed even at r = 0. As the strength of 
the electrical synaptic coupling (g) is increased, the neuronal 
firings become more and more synchronized (see Fig. 3(b)). 
For sufficiently strong g, the measure S approaches 1, indicat- 
ing that the synchronization is almost perfect. Indeed, several 
previous studies have concluded that gap-junctional coupling 
is more effective than chemical coupling in leading to highly 
synchronized states [20]. One possible mechanism for this is 
that chemical synapses only act while the presynaptic neuron 
is spiking, whereas the electrical synapses are more efficient 
and can transmit the membrane potentials of presynaptic neu- 
rons to the corresponding postsynaptic neurons at all times. 

Results presented in Fig. 2 reveal also that the oscillatory 
pattern is largely influenced by the inhibitory synaptic de- 
lay. For suitably short values of r a regular oscillatory pat- 
tern can be observed. Interestingly however, if the delay 
t is sufficiently long, we can observe the emergence of a 
mixed oscillatory pattern, which implies that there are two 



4 




10 20 30 40 

Delay x (ms) 



FIG. 3. (Color online) (a) Dependence of the synchronization mea- 
sure S on the delay r for different values of the inhibitory synaptic 
strength w. Here g = 0. (b) Dependence of S on r for different 
values of the electrical synaptic strength g. Here w = 0.01 ms/cm 2 . 
In all cases we use r s = 10 ms. The units of parameters w and g 
shown in panels (a) and (b) are ms/cm 2 . The positions of the vertical 
dashed lines are: r = 12.5, 25 and 37.5 ms, respectively. 
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FIG. 4. (Color online) Dependence of the synchronization mea- 
sure S on the inhibitory synaptic time constant t s for different val- 
ues of the inhibitory synaptic strength, (a) Without the fast elec- 
trical synapses (g = 0), and (b) with the fast electrical synapses 
(g — 0.005 ms/cm 2 ). In all cases we set r = 8 ms. The values of 
the inhibitory synaptic strength considered here are w — 0.01, 0.02, 
and 0.05 ms/cm 2 , respectively. 



main oscillation frequencies present in the network. One is 
the low frequency of the whole mixed oscillatory pattern and 
the other is the high frequency of the fast oscillations within 
each periodic cycle (see Fig. 2). Theoretically, the mixed os- 
cillatory pattern appears only for sufficiently long inhibitory 
synaptic delay. Under this condition, neurons in the synchro- 
nized or near-synchronized network have enough time to fire 
more than once during a whole periodic cycle, before the 
inhibitory synaptic currents caused by the first synchronous 
spiking group within the same periodic cycle start to sup- 
press their firing. Obviously, the longer the inhibitory synap- 
tic delay t, the more groups of synchronous spikes might be 
contained in each periodic cycle (see t — 18 and 30 ms in 
Figs. 2(a) and 2(b)). Moreover, once the inhibitory synaptic 
currents caused by the first synchronous spiking group start 
to have effect, these currents tend to decrease the membrane 
potentials of neurons and prolong their firing period. In this 
case, the following inhibitory synaptic bombardments due to 
one or more synchronous spiking groups from the same pe- 
riodic cycle will further suppress neuronal firings, and there- 
fore the neurons in the network can fire again only after these 
inhibitory effects wear down or become fully absent. This 
provides a viable mechanism for the emergence of the low- 
frequency component in the mixed oscillatory pattern. While 
performing additional simulations, we have discovered that 
without the long delayed inhibitory synapses, networks of in- 



terneurons cannot generate the mixed oscillatory pattern even 
if we consider the non-physiological case of long electrical 
synaptic delays (data not shown). The above results thus indi- 
cate that the inhibitory synaptic delay serves as an important 
control parameter for the selection of the oscillatory pattern in 
the network, and that long inhibitory synaptic delays provide a 
stable mechanism for the emergence of the mixed oscillatory 
pattern in interneuronal networks. 

We now return to Fig. 3(a) and further discuss the near- 
periodic oscillatory behavior in S. It can be determined that 
the frequency of this near-periodic behavior matches with the 
oscillation frequency of the high-frequency component quite 
well. Note that we will show later that the oscillation fre- 
quency of the high-frequency component is mainly influenced 
by the parameter r s . In the narrow regions of r where the min- 
ima of S appear (note that these regions also correspond to 
the transition points for the number of synchronously spik- 
ing groups contained in each periodic cycle), only a lim- 
ited amount of neurons will participate in the last group of 
synchronous firings within each periodic cycle (see the red 
rectangle in the middle panel of Fig. 3(a)). This can be at- 
tributed to the matching between the synaptic delay t and 
the high-frequency component, which ultimately causes the 
near-periodic behavior in the synchronization measure S. We 
have also performed additional numerical simulations by us- 
ing other models of neuronal dynamics, such as the model 
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by Izhikevich with fast-spiking dynamics [21] and the stan- 
dard Hodgkin-Huxley model [11, 18], and we have observed 
qualitatively identical results, thus confirming the generality 
of this phenomenon (see also [14]). On the other hand, our 
results also reveal that the fast gap-junctional coupling tends 
to suppress the occurrence of such near-periodic oscillations, 
which may be attributed to the overall promotion of synchro- 
nization (see Figs. 3(b)). Indeed, if the electrical coupling is 
sufficiently strong this phenomenon disappears altogether be- 
cause then the neurons in the network are perfectly synchro- 
nized. 

In addition to the time delay r, we also find that the syn- 
chronization depends significantly on the other two impor- 
tant inhibitory synaptic parameters, which are the strength w 
and the time constant r s . Figures 4(a) and 4(b) depict the 
synchronization measure S as a function of r s for different 
values of w, without (g = 0) and with (g ^ 0) the fast 
electrical synapses, respectively. In the absence of fast gap- 
junctional coupling, there exists an optimal region of r s in 
each depicted dependence of S, which implies that the net- 
work can support synchronization optimally only for inter- 
mediate values of r s (see also [18] for related results). In 
this case, a strong inhibitory synaptic strength can drive the 
network towards a high-level of synchronization at the corre- 
sponding optimal value of t s . However, with the increasing 
of w, it can also be observed that the top plateau region of the 
S curve becomes narrower and shifts to the left (the direction 
of short t s ). An explanation why longer t s can no longer pro- 
duce high values of S is as follows. Due to the heterogeneity 
of connectivity, some neurons in the considered network will 
have more inhibitory synaptic inputs than others. For long t s , 
the slowly decaying synaptic inhibition accumulates in time 
and thus may lead to a tonic level of hyperpolarizing currents 
that cancel the external depolarizing currents by neurons with 
more inhibitory inputs [18]. This will suppress or even fully 
disable the firing of such neurons, which in turn means that 
if the synaptic time constant is too long, the synchronization 
will deteriorate significantly. At a fixed r s , a large value of 
w will introduce more inhibition to the network, and thus a 
relatively shorter r s will be needed to impair synchronization. 
As a result, although strong w can enhance the synchroniza- 
tion in the corresponding optimal r s region, they may also 
reduce the size of this region. On the other hand, adding the 
fast gap-junctional coupling to the network, as expected, will 
enhance the synchronous firing of neurons. This enhance- 
ment is quite remarkable, even if the gap-junctional coupling 
is rather weak, as shown in Fig. 4(b). Further increasing the 
strength of gap-junctional coupling can lead to the perfect syn- 
chronization (data not shown). Several previous experiments 
have shown that some of the inhibitory synapses between in- 
terneurons can have rather slow synaptic kinetics [9]. There- 
fore, to some extent, our results suggest that the fast electrical 
synapses might be essential for taming desynchronization if 
an interneuronal network contains a considerable number of 
slow inhibitory synapses. 

Figure 5 shows how the oscillation frequency depends on 
the inhibitory synaptic delay for different levels of inhibi- 
tion. As can be observed, the oscillation frequency of the 
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FIG. 5. (Color online) Dependence of the oscillation frequency on 
the delay r for different levels of inhibition. In all cases we set 
g = 0.03 ms/cm 2 . The units of parameters w and r s shown here are 
ms/cm 2 and ms, respectively. The oscillation frequency is divided 
into three bands: theta band (9: 4-12 Hz), beta band (/3: 12-25 Hz), 
and gamma band (7: 25-100 Hz). Different colors (shades of gray) 
refer to different numbers of synchronously spiking groups contained 
in each periodic cycle. 



considered interneuronal network is determined by both the 
inhibitory synaptic delay as well as the inhibition. In the short 
t region, the oscillations are characterized by a single fre- 
quency. In this case, increasing w and r s can reduce the oscil- 
lation frequency from the 7 band to 8 band (see Fig. 5). Once 
t exceeds a critical time delay t c , we observe that the net- 
work oscillations transit from the one-frequency state to the 
two-frequency state, indicating the emergence of the mixed 
oscillatory pattern. This transition is rapid and stable with 
the aid of fast gap-junctional coupling. For the mixed oscil- 
latory pattern, our results show that both w and t s influence 
the low-frequency component, but only r s has a significant 
effect on the high-frequency component. When t s is short, 
the inhibitory synaptic currents from one periodic cycle de- 
cay fast, so that they may completely vanish before the firing 
of neurons enters into the next periodic cycle and almost do 
not influence the neuronal firing in the next periodic cycle. 
Thus, in this case, the critical time delay r c is approximately 
12.5 ms, and based on the same reason, the number of syn- 
chronous spiking groups contained in each periodic cycle is 
also increased once about every 12.5 ms. The above analysis 
suggests that the oscillation frequency of the high-frequency 
component is around 80 Hz (in the 7 band) for short r s (see 
t s = 8 ms in Fig 5), corresponding to the firing rate of a single 
Wang-Buzsaki neuron that is driven solely by the considered 
externally applied current. If r s is sufficiently long, the in- 
hibitory synaptic currents from one periodic cycle can persist 
to a certain extent even after the neuronal firing enters into the 
next periodic cycle. These remaining inhibitory synaptic cur- 
rents will suppress the neuronal firing in the next periodic cy- 
cle, and thus increase the firing interval between the first and 
the second synchronous spiking groups in the next periodic 
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FIG. 7. (Color online) Dependence of the oscillation frequency on 
Tree for different values of r s . In all cases we set g = 0.02 ms/cm 2 , 
w — 0.05 ms/cm 2 , r = 15 ms, Tin = 3 ms, and uq — 0.2. The 
values of t 3 considered here are t 3 — 8, 15, and 25 ms, respectively. 



FIG. 6. (Color online) Effects of the time constant of the recovered 
variable Tree on the synchronization and the emergence of oscillatory 
pattern in the interneuronal network, (a) Without the fast electrical 
synapses (g — 0). (b) With the fast electrical synapses (g — 0.02 
ms/cm 2 ). In all cases we set r = 18 ms, w — 0.05 ms/cm 2 , r s = 10 
ms, Ti n = 3 ms, and uq = 0.2. Left panel: from top to bottom, 
Tree = 5, 120, 250, and 400 ms, respectively. Right panel: from top 
to bottom, Tree = 5, 150, 320, and 600 ms, respectively. 



cycle. Therefore, the firing intervals of the high-frequency 
component are not perfectly identical, i.e., the first firing in- 
terval is slighter larger than the other firing intervals. This in 
turn yields a relatively smaller average frequency of the high- 
frequency component. As a result, for long r s the system 
needs a relatively longer r to generate the mixed oscillatory 
pattern, and it also exhibits a slightly smaller frequency in the 
high-frequency component of its output (see t s = 20 ms in 
Fig 5). Moreover, our results also show that the frequency of 
the whole mixed oscillatory pattern is quite low, even in the 
case of weak inhibition (small g and short values of r s ). For 
sufficiently long values of r this oscillation frequency can be 
maintained in the 6 band quite efficiently. The mixed theta and 
gamma rhythm is believed to play an important role in brain 
cognitive functions [22]. The traditional viewpoint is that in- 
terneuronal networks with fast and slow inhibitory synaptic 
dynamics are the basic neural circuits to generate this special 
type of neural oscillations [9]. Our results provide a new in- 
sight related to this, which is that long transmission delays 
of inhibitory synapses may also lead to the mixed theta and 
gamma rhythm in interneuronal networks. We note that this 
mechanism is still functional even if only some (not all) of 
the inhibitory synapses are considered to have long transmis- 
sion delays, provided only that the delayed inhibitory synaptic 
currents are strong enough. 

Finally, we examine how the unreliability of inhibitory 



synapses influences the synchronization and oscillatory pat- 
terns in the studied interneuronal network. This investiga- 
tion is carried out because the synaptic transmission through 
real chemical synapses is indeed to a degree unreliable [23], 
and also because several previous studies have advocated that 
the unreliable synapses may play important functional roles 
in neural computation [24]. In principle, the unreliability of 
chemical synapses can be explained by the phenomenon of 
probabilistic transmitter release, which has been confirmed 
by biological experiments [25]. Typically, the synaptic un- 
reliability is associated with synaptic depression, which can 
be simulated by a well-established phenomenological model 
proposed in [26]. In this model, three parameters x%j, yij, and 
Zij, which denote the fractions of synaptic resources in the 
recovered, active, and inactive states, are employed and their 
dynamical equations are given by: Xu = Zij/r rec — u ■ x.ij ■ 
5(t - t) - r), y i:j = -yij/Tin + u ■ x i:j ■ 5{t - t h - - r), and 
iij = Vij / Ti n — / T rec . Here 6(t) is the Dirac delta function, 
tj gives the timing of presynaptic spikes, r,„ is the time con- 
stant of the inactive variable, r rec is the time constant of the 
recovered variable, and ur> describes the utilization of synaptic 
efficacy. Here we apply this model to modulate the updating 
of synaptic conductance as follows: whenever a presynaptic 
neuron j fires a spike, the corresponding postsynaptic conduc- 
tances are increased instantaneously after a fixed spike trans- 
mission delay r, according to ry <— ry + Uij(t); otherwise 
Tij decays exponentially with a fixed time constant t s . In the 
following simulations, we set r^ n = 3 ms and uq = 0.2, and 
change the variable r rec to control the synaptic depression. A 
longer r rec corresponds to a stronger synaptic depression, and 
therefore denotes a lower level of synaptic reliability. 

In Figs. 6(a) and 6(b), we present several typical spike raster 
diagrams for different values of r rec , without (g = 0) and with 
(g 7^ 0) the fast electrical synapses, respectively. We choose 
the inhibitory synaptic delay to equal t — 18 ms, ensuring 
that the network will be in the mixed oscillatory pattern when 
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Tree ms. Results presented in Fig. 6 demonstrate that 
the unreliability of inhibitory synapses has a great impact on 
both the network synchronization and the emergence of os- 
cillatory patterns. In the absence of fast gap-junctional cou- 
pling, the synchronization reduces markedly with increasing 
r rec . In this case, high synaptic unreliability (long r rec ) leads 
to insufficient synaptic information interaction, which largely 
deteriorates network synchronization and causes the neural 
oscillations to disappear completely (see r rec = 400 ms in 
Fig. 6(a)). With the fast gap-junctional coupling incorporated, 
we find that the network synchronization can be maintained in 
the majority of the r rec region. Again, this is because the gap- 
junctional coupling itself can provide an effective mechanism 
for network synchronization. However, our results also show 
that the considered network needs a certain level of inhibitory 
synaptic reliability for the mixed oscillatory pattern to be pre- 
served. For sufficiently long T rec , it can be observed that the 
mixed oscillatory pattern transforms to the regular oscillatory 
pattern due to the lack of inhibition (see r rec = 600 ms in 
Fig. 6(b)). The transitions in the oscillatory patterns can be 
observed more clearly from the data presented in Fig. 7. These 
findings suggest that the unreliability of inhibitory synapses 
might also provide a flexible mechanism for controlling the 
switch between different oscillatory patterns in interneuronal 
networks. 



IV. DISCUSSION 

In summary, we have employed a computational approach 
with the aim of investigating the complex synchronous be- 
havior in interneuronal networks that are coupled by delayed 
inhibitory and fast electrical synapses. We have shown that 
these two types of synaptic coupling play an important role 
in warranting network synchronization. In particular, the con- 
sidered network can achieve a high level of synchronization 
either by means of a suitable tuning of the inhibitory synap- 
tic delay, by enhancing the strength of electrical synapses, or 
by means of both. On the other hand, our simulations have re- 
vealed that only delayed inhibition significantly influences the 
emergence of oscillatory patterns, while electrical synapses 



play at most a side role by this phenomenon. In particular, we 
have shown that short inhibitory delays evoke regular oscil- 
latory patterns, while sufficiently long delays can lead to an 
abrupt emergence of mixed oscillatory pattern. By analyzing 
the oscillation frequencies, we found that the considered in- 
terneuronal network can generate both types of oscillations in 
physiologically relevant frequency bands, such as the gamma 
rhythm and the mixed theta and gamma rhythm. This fact 
might have biological implications as these rhythmic activi- 
ties are frequently associated with fast-spiking interneurons, 
and are also believed to play prominent functional roles in 
cognitive tasks [7, 9, 22]. Lastly, we have also demonstrated 
that the unreliability of inhibitory synapses plays an important 
role by the synchronization of the network as well as by the 
emergence of oscillatory patterns. More precisely, we have 
shown that high levels of unreliability destroy synchroniza- 
tion, and that a minimal level of reliability is needed for the 
emergence and stability of the mixed oscillatory pattern. 

We hope that the presented results will improve our un- 
derstanding of the synaptic mechanisms that are responsible 
for the generation of synchronous oscillations in the neural 
tissue. Indeed, our findings suggest that delayed inhibitory 
synapses are a viable candidate for controlling the emergence 
of oscillatory patterns. Depending on the actual biological 
circumstances, the same interneuronal ensembles may pro- 
duce neural oscillations with different patterns in an adaptive 
way through the modulation of synaptic transmission. We also 
hope that this study will inspire further research on this topic, 
in particular by taking into account additional physiological 
properties of neuronal networks, such as the anatomical con- 
nectivity and distance-dependent synaptic information trans- 
mission delays. 

ACKNOWLEDGMENTS 

This research was supported by the National Natural Sci- 
ence Foundation of China (Grant No. 11172017) and the 
Slovenian Research Agency (Grant No. J 1-4055). D. G. ac- 
knowledges the financial support from the University of Elec- 
tronic Science and Technology of China. 



[1] A. T. Winfree, The Geometry of Biological Time (Springer, 
New York, 1980); A. Pikovsky, M. Rosenblum, and J. Kurths, 
Synchronization: A Universal Concept in Nonlinear Sciences 
(Cambridge University Press, Cambridge, 2001); A. Arenas, A. 
Dfaz-Guilera, J. Kurths, Y. Moreno, and C. Zhou, Phys. Rep. 
469, 93 (2008). 

[2] G. Buzsaki and A. Draguhn, Science 304, 1926 (2004). 

[3] M. Bartos, I. Vida, and R Jonas, Nat. Rev. Neurosci. 8, 45 
(2007); 

[4] J. J. Hopneld, Nature 376, 33 (1995); G. Buzsaki and J. J. 
Chrobak, Curr. Opin. Neurobiol. 5, 504 (1995); M. Whitting- 
ton, R. D. Traub, N. Kopell, B. Ermentrout, and E. H. Buhl, J. 
Neurosci. 38, 315 (2000); A. B. L. Tort, R. W. Komorowski, 
J. R. Manns, N. Kopell, and H. Eichenbaum, Proc. Natl. Acad. 
Sci. USA 106, 20942 (2009). 



[5] T. J. Sejnowski and O. Paulsen, J. Neurosci. 26, 1673 (2006). 
[6] J. R. Gibson, M. Beierlein, and B. Connors, Nature 402, 75 

(1999); B. W. Connors and M. A. Long, Annu. Rev. Neurosci. 

27, 393 (2004). 

[7] R. D. Traub, J. G. R. Jefeerys, and M. Whittington, J. Comput. 
Neurosci. 4, 141 (1997); N. Hajos, J. Palhalmi, E. O. Mann, 
B. Nemeth, O. Paulsen, and T. R Freund, J. Psychophysiol. 24, 
9127 (2004). 

[8] N. Kopell and B. Ermentrout, Proc. Natl. Acad. Sci. USA 101, 

15482 (2004); B. Pfeuty, G. Mato, D. Golomb, and D. Hansel, 

Neural Comput. 17, 633 (2005). 
[9] J. White, M. Banks, R. Pearce, and N. Kopell, Proc. Natl. Acad. 

Sci. USA 97,8128 (2000). 
[10] S. Ostojic, N. Brunei, and V. Hakim, J. Comput. Neurosci. 26, 

369 (2009); S. Coombes, SIAM J. Appl. Dyn. Syst. 7, 1101 



8 



(2008); N. Brunei and V. Hakim, Neural Comput. 11, 1621 
(1999); F. Skinner, N. Kopell, and E. Marder, J. Comput. Neu- 
rosci. 1, 69 (1994). 

[11] W. Gerstner and W. M. Kistler, Spiking Neuron Models: Single 
Neruons, Populations, Plasticity (Cambridge University Press, 
Cambridge, 2002); E. Kandel, J. Schwartz, and T. Jessell, Prin- 
ciples of Neural Science (Elsevier, Amsterdam, 1991). 

[12] M. D. Mann, The Nervous System and Behavior: An Introduc- 
tion (Harper and Row, Maryland, 1981); E. M. Izhikevich, Neu- 
ral Comput. 18, 245 (2006). 

[13] H. A. Swadlow, J. Neurophysiol. 54, 1346 (1985); H. A. Swad- 
low, J. Neurophysiol. 68, 605 (1992); A. Roxin, N. Brunei, and 
D. Hansel, Phys. Rev. Lett. 94, 238103 (2005); C. Masoller, 
M. C. Torrent, and J. Garci'a-Ojalvo, Phys. Rev. E 78, 041907 
(2008); C. Masoller, M. C. Torrent, and J. Garci'a-Ojalvo, Phil. 
Trans. R. Soc. A 367, 3255 (2009); T. Perez, V. Egufluz, and 
A. Arenas, Chaos 21, 025111 (2011); V. Egufluz, T. Perez, 
J. Borge-Holthoefer, and A. Arenas, Phys. Rev. E 83, 056113 
(2011). 

[14] M. Dhamala, V. K. Jirsa, and M. Ding, Phys. Rev. Lett. 92, 
074104 (2004); Q. Wang, G. Chen, and M. Perc, PLoS ONE 6, 
el5851 (2011); Q. Wang, M. Perc, Z. Duan, and G. Chen, Phys. 
Rev. E 80, 026206 (2009); O. V. Popovyh, S. Yanchuk, and P. 
A. Tass, Phys. Rev. Lett. 107, 228102 (201 1); Z. Wang, H. Fan, 
and K. Aihara, Phys. Rev. E 83, 051905 201 1. 

[15] I. Franovic and V. Miljkovic, Chaos, Solitons & Fractals 44, 
122 (201 1); O. D'Huys, I. Fischer, J. Danckaert, and R. Vicente, 
Phys. Rev. E 83, 046223 (2001); J. Zhou and Z. Liu, Phys. Rev. 
E77, 056213 (2008). 

[16] R. Maex and E. De Schutter, J. Neurosci. 23, 10503 (2003); 
M. Bartos, I. Vida, M. Frotscher, A. Meyer, H. Monyer, J. R. 
P. Geiger, and P. Jonas, Proc. Natl. Acad. Sci. USA 99, 13222 
(2002); N. Brunei and X. J. Wang, J. Neurophysiol. 90, 415 



(2003). 

[17] X. J. Wang and G. Buzsaki, J. Neurosci. 16, 6402 (1996). 
[18] A. L. Hodgkin and A. F. Huxley, J. Physiol. (London) 1 17, 500 
(1952). 

[19] L. Neltner, D. Hansel, G. Mato, and C. Meunier, Neural Com- 
put. 12, 1607 (2000); C. Li and Q. Zheng, Phys. Biol. 7, 036010 
(2010). 

[20] R. D. Traub, N. Kopell, A. Bibbig, E. H. Buhl, F. E. N. LeBeau, 
and M. A. Whittington, J. Neurosci. 21, 9478 (2001); X. Li, K. 
Morita, H. P. C. Robinson, and M. Small, Cogn. Neurodyn. 5, 
241 (2011). 

[21] E. M. Izhikevich, IEEE Trans. Neural Networks 14, 1569 
(2003). 

[22] R. T. Canolty, E. Edwards, S. S. Dalai, M. Soltani, S. S. Na- 
garajan, H. E. Kirsch, M. S. Berger, N. M. Barbaro, and R. T. 
Knight, Science 313, 1626 (2006); O. Jensen, Neurosci. 139, 
237 (2006); K. M. Kendrick, Y. Zhan, H. Fischer, A. U. Nicol, 
X. Zhang, and J. Feng, BMC Neurosci. 12, 55 (201 1). 

[23] B. Katz, The Release of Neural Transmitter Substances (Liver- 
pol University Press, Liverpool, 1969); M. Abeles, Corticonics: 
Neural Circuits of the Cerebral Cortex (Cambridge University 
Press, New York, 1991); D. K. Smetters and A. Zador, Current 
Biology 6, 1217 (1996). 

[24] D. Guo and C. Li, J. Comput. Neurosci. 30, 567 (2011); M. S. 
Goldman, Neural Comput. 16, 1137 (2004). 

[25] C. Allen and C. F. Stevens, Proc. Natl. Acad. Sci. USA 91, 
10380 (1994); T. Branco and K. Staras, Nat. Rev. Neurosci., 
10, 373 (2009). 

[26] M. Tsodyks and H. Markram, Proc. Natl. Acad. Sci. USA 94, 
719 (1997); M. Tsodyks, K. Pawelzik, H. Markram, Neural 
Comput. 10, 821 (1998); A. Morrison, M. Diesmann, and W. 
Gerstner, Biol. Cybern. 98, 459 (2008). 



